Data Wrangling with Spark

Back to Home

01. Introduction
02. Functional Programming
03. Why Use Functional Programming
04. Procedural Example
05. Procedural [Example Code]
06. Pure Functions in the Bread Factory
07. The Spark DAGs: Recipe for Data
08. Maps and Lambda Functions
09. Maps and Lambda Functions [Example Code]
10. Data Formats
11. Distributed Data Stores
12. SparkSession
13. Reading and Writing Data into Spark Data Frames
14. Read and Write Data into Spark Data Frames [example code]
15. Imperative vs Declarative programming
16. Data Wrangling with DataFrames
17. Data Wrangling with DataFrames Extra Tips
18. Data Wrangling with Spark [Example Code]
19. Quiz - Data Wrangling with DataFrames
20. Quiz - Data Wrangling with DataFrames Jupyter Notebook
21. Quiz [Solution Code]
22. Spark SQL
23. Example Spark SQL
24. Example Spark SQL [Example Code]
25. Quiz - Data Wrangling with SparkSQL
26. Quiz [Spark SQL Solution Code]
27. RDDs
28. Summary

Back to Home

22. Spark SQL

Spark SQL

L2 05 01 Intro To SQL V1

Spark SQL resources

Here are a few resources that you might find helpful when working with Spark SQL

Spark SQL built-in functions
Spark SQL guide

Learn Udacity: click here to learn more :)